Appears in 9th Int'l Workshop on Non-Monotonic Reasoning (NMR '2002). 



Interpolation Theorems for Nonmonotonic Reasoning Systems 



Eyal Amir 

Computer Science Division 
University of CaHfornia at Berkeley 
Berkeley, CA 94720-1776, USA 
eyal@cs.berkeley.edu 



Abstract 



inference into pieces associated with sublanguages of 



Craig's interpolation theorem | ]Craig, 1957 ] is an 
important theorem known for propositional logic 
and first-order logic. It says that if a logical 
formula /3 logically follows from a formula a, 
then there is a formula 7, including only symbols 
that appear in both a, /3, such that (i logically 
follows from 7 and 7 logically follows from a. 
Such theorems are important and useful for un- 
derstanding those logics in which they hold as 
well as for speeding up reasoning with theories 
in those logics. In this paper we present interpo- 
lation theorems in this spirit for three nonmono- 
tonic systems: circumscription, default logic and 
logic programs with the stable models seman- 
tics (a.k.a. answer set semantics). These results 
give us better understanding of those logics, es- 
pecially in contrast to their nonmonotonic char- 
acteristics. They suggest that some monotonic- 
ity principle holds despite the failure of classic 
monotonicity for these logics. Also, they some- 
times allow us to use methods for the decomposi- 
tion of reasoning for these systems, possibly in- 
creasing their applicability and tractability. Fi- 
nally, they allow us to build structured represen- 
tations that use those logics. 



1 Introduction 



Craig's interpolation theorem [ Craig, 1957 | is an important 
theorem known for propositional logic and first-order 
logic (FOL). It says that if a, (3 are two logical formulae 
and a \- (i, then there is a formula 7 G C{a) n 
such that a h 7 and 7 h /? ("h" is the classical logical 
deduction relation; C{a) is the language of a (the set 
of formulae built with the nonlogical symbols of a, 
L{a))). Such interpolation theorems allow us to break 



the language of that theory [Mcllraith and Amir, 2001] 



for those formal systems in which they hold. In AI, 
these properties have been used to speed up inference for 
constraint satisfaction systems (CSPs), propositional logic 
and FOL (e.g., [pechter and Pearl l"988|, parwiche, 1998 , 



Icllraith and Am ir, 2001 
)arwiche, 1997 



iDechter and Rish, 1994 



Amir and Mcllraith, 200C 



echter, 1999|| and to build structured repr esentations 
[[Parwiche, 1998i|Amir, 2000i [Parwiche, 1997|] 



In this paper we present interpolation theo- 
for thre e nonmonoton ic systems: cir- 
[ [McCarthy, 1980t , default logic 
[ [Reiter, 1980| | and logic programs with the A n- 



rems 
cumscription 



swer Set semantics [pelfond and Lifschitz, 1991 



pn 



jelfond and Lifschitz, 1988 ]. In the nonmonotonic 
setup there are several interpolation theorems for each 
system, with different conditions for applicability and 
different form of interpolation. This stands in con- 
trast to classical logic, where Craig's interpolation 
theorem always holds. Our theorems allow us to 
use methods for the decomposition of reasoning (a-la 
[|Amir and Mcllraith, 2000i [Mcllraith and Amir, 200H]) 



under some circumstances for these systems, possibly 
increasing their applicability and tractability for structured 
theories. We list the main theorems that we show in 
this paper below, omitting some of their conditions for 
simplicity. 

For circumscription we show that, under some condi- 
tions, Circ[a\ P;Q] \= (3 iff there is some set of 
formulae 7 C C{a) n C{f3) such that a ^ 7 
and Circ['y; P; Q] ^ f3. For example, to answer 
Circ[BlockW; block; L{BlockW)] ^ on{A, B), we can 
compute this formula 7 G C{{block, on, A, B}) from 
BlockW without applying circumscription, and then solve 
Circ[j; block; L{BlockW)] \= on{A, B) (where 7 may 
be significantly smaller than BlockW). 

For default logic, letting a /? mean that every exten- 



sion of (a, D) entails /3 (cautious entailment), we show 
that, under some conditions, if a Y^o (3, then there is a 
formula 7 e C{a U £>) fl C{P) such that a 7 and 
7 h"!? /5- For logic programs we show that if Pi , P2 are 
two logic programs and </? e C{P2) such that Pi UP2 f, 
then there is 7 e C{Pi) n C{P2) such that Pi |~'' 7 and 
P2 U 7 |~'' tf (here is the brave entailment for logic 
programs). 

This paper focuses on the form of the interpolation the- 
orems that hold for those nonmonotonic logics. We do 
not address the possible application of these results to 
the problem of automated reasoning with those logics. 
Nonetheless, we mention that direct application of those 
results is possible along the l ines already explored for 
propositional logic and FO L in | Amir and Mcllraith, 200C , 
[Vlcllraith and Amir, 200l| ]. 



No interpolation theorems were shown for nonmonotonic 
reasoning systems before this paper. Nonetheless, some of 
our theorems for default logic and logic programs are close 
to the splitting theorems of [Lifschitz and Turner, 1994, 
Turner, 1996|, which have already been used to decompose 
reasoning for those logics. The main difference between 
our theorems and those splitting theorems is that the latter 
change some of the defaults/rules involved to provide the 
corresponding entailment. Also, they do not talk about an 
interpolant 7, but rather discuss combining extensions. 

Since its debut, the nonmonotonic reasoning line of work 
has expanded and several textbooks now exist that give 
a fair view of nonmonotonic reasoning and its uses (e.g., 
[Gabbay ef fl/., 1993]). The reader is referred to those 



books for background and further details. 

2 Logical Preliminaries 

In this paper, we use the notion of logical theory for every 
set of axioms in FOL or propositional logic, regardless of 
whether the set of axioms is deductively closed or not. We 
use L{A) to denote the signature of A, i.e., the set of non- 
logical symbols. C{A) denotes the language of A, i.e., the 
set of formulae built with L{A). Cn{A) is the set of logical 
consequences of A (i.e., those formulae that are valid con- 
sequences of A in FOL). For a first-order structure, M, in 
L, we write U (M) for the universe of elements of M. For 
every symbol, s, in L, we write s^^ for the interpretation of 
s in M. 

Finally, we note Craig's Interpolation Theorem. 



Theorem 2.1 ( QCraig, 1957| ]) Let a, (3 be sentences such 
that a \- p. Then there is a formula 7 involving only non- 
logical symbols common to both a and (3, such that a h 7 
and 7 h /3. 



3 Circumscription 



3.1 McCarthy's Circumscription: Overview 



McCarthy's circumscription [ [McCarthy, 198C , 
McCarthy, 198(: ] is a nonmonotonic reasoning system in 
which inference from a set of axioms. A, is performed 
by minimizing the extent of some predicate symbols P, 
while allowing some other nonlogical symbols, ^ to vary. 



Formally, McCarthy's circumscription formula 

Circ[A{P, Z); P: Z] = 
A{P, Z) A Vp, z {A{p, z) => -^{p < P)) 



(1) 



says that in the theory A, with parameter relations and func- 
tion vectors (sequence of symbols) P, Z, P is a minimal 
element such that A{P, Z) is still consistent, when we are 
allowed to vary Z in order to allow P to become smaller. 

Take for example the following simple theory: 

T = block{Bi) Ablock{B2) 

Then, the circumscription of block in T, varying nothing, 
is 



Circ[T; block;] =T A^p 



block /p] 



-i{p < block)]. 



Roughly, this means that block is a minimal predicate satis- 
fyi ng T. Computin g circumscription is discussed in length 
in [ Lifschitz, 1993 1 and others, and we do not expand on it 
here. Using known techniques we can conclude 

Circ[T; block; ] = \/x {block{x) ^ (x = Pi V a; = P2)) 

This means that there are no other blocks in the world other 
than those mentioned in the original theory T. 

We give the preferential semantics for circumscrip- 
tion that was given by [ [Lifschitz, 198^ , [McCarthy, 198^ 
l^therington, 1986 ] in the following definition. 



Definition 3.1 ([ jLifschitz, 1985| ]) For any two models M 
and N of a theory T we write M <p^z N if the models 
M, N differ only in how they interpret predicates from P 
and Z and if the extension of every predicate from P in M 
is a subset of its extension in N. We write M <p,z N if 
for at least one predicate in P the extension in M is a strict 
subset of its extension in N. 

We say that a model M of T is <p z-minimal if there is no 
model N such that N <p^z M. 



Theorem 3.2 ([ [Lifschitz, 1985p : Circumscript. Semantics) 

Let T be a finite set of sentences. A structure M is a model 
ofCirc[T; P; Z] iff M is a <p z-minimal model ofT. 



This theorem allows us to extend the definition of circum- 
scription to set of infinite number of sentences. In those 
cases, Circ[T; P; Z] is defined as the set of sentences that 
hold in all the <p^2-minimal models of T. Theorem 3.2 
implies that this extended definition is equivalent to the 
syntactic characterization of the original definition (equa- 
tion ([l|)) if T is a finite set of sentences. In the rest of this 
paper, we refer to this extended definition of circumscrip- 
tion, if T is an infinite set of FOL sentences (we will note 
those cases when we encounter them). 

Circumscription satisfied Left Logical Equivalence (LLE): 
T = T' impHes that Circ[T; P; Z] = Circ[T'; P; Z]. It 
also satisfies Right Weakening (RW): Circ[T; P;Z] \= ip 
and LP ^ ^ implies that Circ[T] P; Z] ^ tp). 

3.2 Model Theory 

Definition 3.3 Let M, N be L-structures, for FOL signa- 
ture L and language C. We say that N is an elemen- 
tary extension of M (or M is an elementary substruc- 
ture of N), written M ^ N, ifU{M) C U{N) and for 
every ip{lt) € C and vector of elements "a* of U{M), 
M h ^( a*) iffN h ^( a*). 

f : M ^ N is an elementary embedding if / is an injective 
(one-to-one) homomorphism from M to N and for every 
ifi{li^) 6 jC and vector ~a' = (oi, a„) of elements from 
U(M) (i.e., ai,..,a„ e U{M)), M \= ip(-dt) iff N ^ 
V3(/(ai),. ..,/(«„)). 

For FOL signatures L C L+, and for N an L+-structure, 
we say that N \ Lis the reduct of N to L, the L-structure 
with the same universe of elements as N, and the same 
interpretation as N for those symbols from i+ that are in 
L (there is no interpretation for symbols not in L). For A 
theory T in a language of L+, let Cn^{T) be the set of all 
consequences of T in the language of L. 

The following theorem is a model-theoretic property that is 
analogous to Craig's interpolation theorem (Theorem 2. 1 ). 



C{(3 U P) such that a classically entails 7 (a [=7) and 
7 nonmonotonically entails j3 {Circ['y] P; Q] |= /3). In the 
FOL case this 7 can be an infinite set of sentences, and we 
use the extended definition of Circumscription for infinite 
sets of axioms for this statement. 



Tlieorem 3.4 (See QHodges, 1997| | p.l48) Let L,L+ be 

FOL signatures with L C L+ and T a theory in the lan- 
guage of L^ . Let M be an L-structure. Then, M \= 
Cn^ (T) if and only if for some model N ofT, M < N \ L 
( M is an elementary substructure of the reduct of N to L). 

3.3 Interpolation in Circumscription 

In this section we present two interpolation theorems for 
circumscription. Those theorems hold for both FOL and 
propositional logic. Roughly speaking, the first (Theorem 
^Ts] ) says that if a nonmonotonically entails /? (here this 
means Circ[a; P; Q] |= (3), then there is 7 C £{a) Pi 



The second theorem (Theorem 3.1 1 ) is similar to the first 



with two main differences. First, it requires that L{a) C 
{P U Q). Second, it guarantees that 7 as above (and some 
other restrictions) exists iff a nonmonotonically entails (3. 
This is in contrast to the first theorem that guarantees only 
that ;/ part. The actual technical details are more fine than 
those rough statements, so the reader should refer to the 
actual theorem statements. 

In addition to these two theorems, we present another theo- 
rem that addresses the c ase of reasoning from the union of 
theories (Theorem 3.10 ). Before we state and prove those 
theorems, we prove several useful lemmas. 

Our first lemma says that if we are given two theories 
Ti,T2, and we know the set of sentences that follow from 
T2 in the intersection of their languages, then every model 
of this set of sentences together with Ti can be extended to 
amodelof Ti UTa. 

Lemma 3.5 Let Ti , T2 be two theories, with signatures in 
Li, L2, respectively. Let ^ be a set of sentences logically 
equivalent to Cn^^^^'^{T2). For every Li-structure, M., 
that satisfies Ti U7 there is a [Li U L2)-structure, A4, that 
is a model o/Ti U T2 such that A4 ^ A4 \ Li. 

Proof Let be a ii -structure that is a model of 
Ti U 7. Then Ai j. Noticing that 7 is logically equiva- 
lent to Cn^^'^^^ {T2) (by definition of 7), we get that 7 ^ 
Cn^i^^2(T2). Consequently, 7 \= Cn^^{T2) because 
Cn^ir^L^ij^^) = Cn^i(Cn^ini2(r2)) = Cn^^{T2). 



Now we use Theorem 3.4 with L = Li, L^ = ii U L2, 
M = X and T = Ti U T2. We know that X |== Ti U 
7. Thus, i\/ 1= Ti U Cn^i(r2). To use Theorem U we 
need to show that M ^ Cn-^i (Ti U T2). We use Craig's 
interpolation theorem (Theorem 2A) to show this is indeed 
the case. 

First notice that Cn^^ (Ti UT2) 3 Cn^^ (Ti U7) is true be- 
cause T2 h 7- We show that Cn^i (Ti UTa) C Cn^^ (Ti U 
7). Take ip e Cn^i (Ti U T2). By definition, Ti U Ta |= <y5 
and (p G 'C(Ti). The deduction theorem for FOL implies 
that T2 ^ T{ ^ ip, for some finite subset T{ C Ti. 
Craig's interpolation theorem for FOL implies that there 
isS e C{T2) n C{T[ ^ (p) ^ C{T2) n C{Ti) such that 
Ta h (5 and 5 h T[ ip. Thus, 6 G Cn^i"-^^ (Ta) = 7. 
Consequently, 7 ^ r{ => (p. Using the deduction theorem 
again we get that TlU j \^ ip, implying that Ti IJ j ip. 

Thus, we showed that Cn^^ (Ti U T2) = Cn^^ (Ti U 7). 



From M |= TiUCn^^ {T2) and 7 = Cn^^ (Tz) we get that 



Finally, the conditions of Theorem 3.4 for L = Li, L+ = 
Li U L2, M = X and T = Ti U la^hold. We conclude 
that there is a (Li U L2)-structure, M, that is a model of 
Ti U T2 such that M ^ M \ Li. ■ 

Our second lemma says that every < p g-minimal model of 
T that is also a model of T' is a <p Q-minimal model of 
TUT'. 

Lemma 3.6 Let T be a theory and P, Q vectors ofnonlog- 
ical symbols. If M \= Circ[T; P; Q] and M |= T U T', 
then M h Circ[T U T'; P; Q]. 

Proof Let Mhta model of T U T' such that M |= 
Circ[T;P; Q]. If there is M' <p,q M such that M' h 
T U T', then X' ^ T and 7W 1^ C'irc[r; P; Q]. Contra- 
diction. Thus, there is no such Ai' and A4 \= Circ[T U 
T';P;Q]. ■ 

The following theorem is central to the rest of our results 
in this section. It says that when we circumscribe P, Q in 
Ti U T2 we can replace T2 by its consequences in C{Ti), 
for some purposes and under some assumptions. 

Theorem 3.7 Let Ti , T2 be two theories and P, Q two 
vectors of symbols from L(Ti) U L{T2) such that P C 
L(Ti). Let 7 a set of sentences logically equivalent to 
Cn^{Ti)nL(T2)(T2). Then, for all ip C{Ti), ifCirc[Ti U 
T2] P; Q] h= if, then Circ[Ti U 7; P; Q] h tp- 

Proof We show that for every model of Circ[Ti U 
7; P; Q] there is a model of Circ[Ti UT2;P; Q] whose 
reduct to L{Ti) is an elementary extension of the reduct of 
the first model to L{Ti). 

Let be a L(ri U r2) -structure that is a model of 
Circ[Ti U 7; P; Q]. Then, M h T^i U 7. From Lemma 
3.5 we know that there is a [Li U L2) -structure, J\A, that is 
a model of r2 such that M \ L{Ti) < M \ L{Ti). 

Thus, is a <p Q-minimal model of Ti U 7. To see this, 
assume otherwise. Then, there is a model AA' for the signa- 
ture L{Ti U T2) such that M' < p,q A? and |= Ti U 7. 
Take A4" such that the interpretation of all the symbols 
in L{Ti) is exactly the same as that of A4' and such that 
the interpretation of all symbols in L{T2) \ L{Ti) is ex- 
actly the same as that of M. Then, M" ^ Ti U 7 because 
riU7 C £(Ti). Also, X" <p,Q. X,forg' = Qni(Ti) 
because P C L{Ti) and A^, J\A agree on the interpretation 
of symbols in P(ri) {M \ L{Ti) ^ M \ L{Ti)). Thus, 
Ai" <p.Q M, since A^",A^ agree on all the interpre- 
tation of all symbols in L{T2) \ L{Ti). This contradicts 



M 1= Circ\Ti U7; P; Q], so A^ is a <p^Q-minimal model 
of Ti U 7. 

Thus, M h Circ[Ti U 7; P; Q], and A? h U r2. From 
Lemma U we get that M |= Circ[Ti \JT2\P;Q]. 

Now, let LP e £(Ti) such that Circ[Ti UT2;P;Q] h 
Then every model of Circ[Ti UT2;P; Q] satisfies (p. Let 
A^ be a model of Circ[Ti U7; P; Q] in the language C{Ti U 
r2). Then there is M as above, i.e., M ^ Circ[Ti U 
T2; P; Q] and X \ L{Ti) r< A? f P(ri). Thus, M ^ ip. 
Since A^ \ L{Ti) ^ M \ P(Ti), M ^ p. Thus every 
model of Circ\Ti U 7; P; Q] is a model of p. ■ 

Theorem 3.8 (Interpolation for Circumscription 1) Let 

T be a theory, P, Q vectors of symbols, and p) a formula. 
IfCirc[T; P; Q] ^ p, then there is 7 C C{T) D C{p U P) 
such that 

T 1= 7 and Circ['y; P; Q] ^ (yS. 

Furthermore, this 7 can /je logically equivalent to the con- 
sequences ofT in L{T) fl L{p U P). 



Proof We use Theorem 3.7 to find this 7. For T, 1^9 as 
in the statement of the theorem we define Ti , T2 as follows. 
We choose Ti such that p G C{Ti) and P C L(ri): Let 
Ti = {(^V^(^}Uri for ri a set of tautologies such that 
L(ri) = P. We choose T2 such that it includes T and has a 
rich enough vocabulary so that P,Q C L(Ti) U ^(^2)- Let 
T2 — T U T2, for r2 a set of tautologies such that L{t2) = 
Q \ L{Ti). Let Li = L{Ti), L2 = L{T2). 

Theorem guarantees that if P C Li then 7 from that 
theorem satisfies Circ[Ti \JT2]P;Q] h ^ Circ[Ti U 
7;P;Q] ^ i/' for every 'ip € 'C(Ti). This implies that 
for every t/. e £({(^1 U n), Circ[T-P-Q] h ^ 
Circl-f; P; Q] ^ In particular, Circ[7; P; Q] H 
and this 7 satisfies our current theorem. ■ 

This theorem does not hold if we require 7 C £{T) r\C{p) 
instead of7 C C{T)n£{pUP). For example, take — Q, 
T = {^P => Q}, where P, Q are propositional symbols. 
Circ[T; P; Q] |= p. However, every logical consequence 
of T in L{p) is a tautology. Thus, if the theorem was cor- 
rect with our changed requirement, 7 would be equivalent 
to and Circ[-/; P; Q] ^ </?. 

Theorem 3.9 Let Ti , T2 fwo theories, P, Q fwo vecfori 
of symbols from L{Ti) U ^(^2) iMc/i f/zaf P C L{Ti) and 
P [J Q Z) L{T2). Let j be a set of sentences logically 
equivalent to Cn^^'^''>^^^'^^'> {T2). Then, for all p G C{Ti), 
ifCirc[Ti U 7; P; Q] ^ V, then Circ[Ti U T2; P; Q] ^ V- 

Proof We show that every model of Circ[Ti U 
T2 ; P; Q] is also a model of Circ[Ti U7; P; Q] . Let A1 be a 



L(TiUr2)-stmcturethat is amodelof Circ[TiUT2; P; Q]. 
Then M |= Ti U implying that also M |= Ti U 7. 

Assume that there is M' < p.q M such that M' |= Ti U7. 
From Lemma |33|, there is M' such that M' |= Ti U T2 
and M' \ L{Ti) ^ M' \ L{Ti). Since M',M' agree 
on all the symbols of L{Ti), we get that M' <p,q M' 
(because P U Q 3 ^(^2))- Finally, we get that M' <p^q 
Ai' <p.Q A4, contradicting the assumption of M being 
<p^Q-minimal satisfying Ti U T2. Thus, is a model of 

Circ[TiUr,P;Q]- 

Now, let if e C{Ti) such that Circ[Ti U 7; P; Q] \= ip. 
Then every model of Circ[Ti U7; P; Q] satisfies (p. Let A4 
be a model of Circ[Ti U T2; P; Q] in the language C{Ti U 
T2). Then, M \= Circ[Ti U 7; P; Q] and M ^ ip. Thus, 

C'trc[Tiur2;P;Q] h<P- ■ 



From Theorem 3.7 and Theorem 3.S we get the following 
theorem. 

Theorem 3.10 (Interpolation Between Theories) Let 

Ti , r2 be two theories, P, Q vectors of symbols in 
L{Ti) U L{T2) such that P C L(Ti) andPUQ D ^(Tz). 
Let "f be a set of sentences logically equivalent to 

Cn^m)nL{T2)(j^^y Then, for every ip e C{Ti), 



Circ[Ti U 7; P; g] h 



Circ[TiUT2;P;Q] \= ip 



Theorem 3.11 (Interpolation for Circumscription 2) 

Let T be a theory, P, Q vectors of symbols such that 
{P U Q) 3 L{T). Let Li be a set of nonlogical symbols. 
Then, there is 7 G 'C(T) H >C(p2 U P) such that T ^ 7 
and for all ip G C^Li), 



Circ[T;P;Q]^^ 



Czrc[7;P;Q] h^- 



Furthermore, this 7 can be logically equivalent to the con- 
sequences ofT in L{T) fl {L2 U P). 

Proof Let Ti be a set of tautologies such that P(Ti) = 
P2 U P. Also, let r2 = r U T2, for T2 a set of tautologies 
such that i(T2) =_Q \ L{Ti). Let Li = L(Ti), ^2 = 
L{T2). Theorem 3.10 guarantees that 7 from that theorem 
satisfies Circ[r, P; Q] h Circ[T; P;Q]\=ip for 

every ■0 G -Ci = ^2 U P. ■ 

The theorems we presented are for parallel circumscription, 
where we minimize all the minimized predicates in parallel 
without priorities. The case of prioritized circumscription 
is outside the scope of this paper. 

4 Default Logic 



our propositional default theories is finite (this also implies 
that our theories are finite). 

4.1 Reiter's Default Logic: Overview 



In Reiter's default logic jReiter, 1980| ] one has a set of facts 
W (in either propositional or FOL) and a set of defaults 
D (in a corresponding language). Defaults in D are of 
the form with the intuition that if a is proved, 

and Pi, ...,(3n are consistent (throughout the proof), then 
5 is proved, a is called the prerequisite, pre{d) = {a}; 
[3i, Pn are the justifications, just{d) = {/3i, /?„} and 
5 is the consequent, cons{d) — {5}. We use similar nota- 
tion for sets of defaults (e.g., cons{D) = Uden cons{d)). 
Notice that the justifications are checked for consistency 
one at a time (and not conjoined). 

Take, for example, the following default theory T = 

{W,D): 

Intuitively, this theory says that birds normally fly and that 
Tweety is a bird. 

An extension of {W, D) is a set of sentences E that satis- 
fies W, follows the defaults in D, and is minimal. More 
formally, E is an extension if it is minimal (as a set) such 
that r(£') = E, where we define r(5o) to be S, a minimal 
set of sentences such that 



L WZ S; S ^ Cn{S). 



2. For all 
5eS. 



G D if a e S* and Vi ^ 5*0, then 



The following theorem provides an equivalent defini- 
tion that was shown in [ Marek and Truszczyriski, 1993 



^isch and Schwind, 19941 [Baader and Hollunder, 1995| ] 



A set of defaults, 
W iff for all d G 

Mon(B) = {^^^ 



is grounded in a set of formulae 

pre{d) G CnMon{o){W), where 
d G B}. 



Theorem 4.1 (Extensions in Terms of Generating Defaults) 

A set of formulae E is an extension of a default theory 
{W, D) iff E = Cn{W U {cons{d) \ d G D'}) for a 
minimal set of defaults D' ^ D such that 

7. D' is grounded in W and 
2. for all d G D: 



In this section we present interpolation theorems for propo- 
sitional default logic. We also assume that the signature of 



d G £>' iffpre{d) G Cn{W U cons{D')) and 

for all ij e justid),^ilj ^ Cn{W U cons{D')). 



Every minimal set of defaults £)' C D as mentioned in this 
theorem is said to be a set of generating defaults. 

Normal defaults are defaults of the form These de- 
faults are interesting because they are fairly intuitive in na- 
ture (if we proved a then /3 is proved unless previously 
proved inconsistent). We say that a default theory is nor- 
mal, if all of its defaults are normal. 

We define W [^d as cautious entailment sanctioned by 
the defaults in D, i.e., cp follows from every extension of 
{W, D) . We define W \^\, as brave entailment sanc- 
tioned by the defaults in D, i.e., <p follows from at least one 
extension of (W, D). 

4.2 Interpolation in Default Logic 

In this section we present several flavors of interpolation 
theorems, most of which are stated for cautious entailment. 

Theorem 4.2 (Interpolation for Cautious DL 1) Let 

T = {W, D) be a propositional default theory and Lp a 
propositional formula. IfW V, then there are 71,72 
suchthat-fi e C{W)nC{DU{(p}), 72 e C{WUD)nC{(p) 
and all the following hold: 



1= 71 71 

W 72 71 



72 72 h <y5 



Proof Let 71 be the set of consequences of W in 
C{D U {1^}) n C{W). Let E be the set of extensions of 
{W, D) and E' the set of extensions of (71, D). We show 
that every extension E' G E' has an extension E' G E such 
that Cn{E' {JW) = Cn{E). This will show that 71 is as 
needed. 

Take E' G E' and define Eq = Cn{E' U H/). We assume 
that L{E') C L{M) because otherwise we can take a log- 
ically equivalent extension whose sentences are in £(11)). 
We show that Eq satisfies the conditions for extensions of 

{W,D): 



I. WZ Eq, 

For all ^ 
then 5 e Eq. 



for propositional logic we get W \= E' ^ a (taking E' 
here to be a finite set of sentences that is logically equiva- 
lent to E' in £(]D)) (there is such a finite set because we as- 
sume that I/(D) is finite)). Using Craig's interpolation the- 
orem for propositional logic, there is 7 G C{W) fl C{E' 
a) such that |= 7 and j \^ E' ^ a. However, 
this means that 71 ^ 7, by the way we chose 71. Thus 
^ £" a. Since E' C 71 we get that E' |= a. Since 
E' = Cn{E') we get that a G E'. 

The case is similar for S: if 6 £ Eq then 5 E E' hy the same 
argument as given above for a £ Eq ^ a £ E' . Finally, if 

\/i -^l3, ^ Eq then Vi -.^ ^ E' because E' C Eq. 

The opposite direction (every default that is consistent with 
E' is also consistent with Eq) is similar to the first one. 

Thus, Eq satisfies those two conditions. However, it is pos- 
sible that £'0 is not a minimal such set of formulae. If so. 



2. For all e D,ifa £ Eq and Vi -^f3, ^ Eq, 



Theorem 4. 1 implies that there is a strict subset of the gen- 
erating defaults of Eq that generate a different extension. 
However, we can apply this new set of defaults to generate 
an extension that is smaller than £", contradicting the fact 
that E' is an extension of (71, D). 

Now, if <p logically follows in all the extensions of {W, D) 
then it must also follow from every extension of (71 , D) 
together with W. Let A = iJi V ... V £'„, for Ei,...,En 
the (finite) set of (logically non-equivalent) extensions of 
(VF, D) (we have a finite set of those because L{W)\JL{D) 
is finite). Then, ip. Take 72 G C{K) n C{'p) such that 
A 1= 72 and 72 ^ ip, as guaranteed by Craig's interpolation 
theorem (Theorem 2.1). These 71,72 are those promised 
by the current theorem: W ^ 71, 72 ^ ip, W 72, 
71 l~D 72 and 71 V- ■ 

Theorem 4.3 (Interpolation for Cautious DL 2) Let 

T — (yV, D) be a propositional default theory and ip 
a propositional formula. If W then there are 

71, 72 G C{W) n C{D), and all the following hold: 

1= 71 71 |--_D 72 

{72} IJW ^ (p W 12 



The proof is similar to the one for Theorem 4.2 



The first condition holds by definition of Eq. The sec- 
ond condition holds because every default that is consistent 
with Eq is also consistent with E' and vice versa. We detail 
the second condition below. 

For the first direction (every default that is consistent with 



Eq is also consistent with E'), let 
that a G i?o- We show that a e E'. 



G D be such 



By definition, a G C{D). a e Eq implies that E'UW ^ a 
because Cn{E' U W) — Eq. Using the deduction theorem 



Corollary 4.4 Let {W,D) be a default theory and ip a 
formula. If W then there is a set of formulae, 

7 G L{W U £>) n £(iy9) such that W Y^d 1 and 7 v?. 

Proof Follows immediately from Theorem with 72 
there corresponding to our needed 7. ■ 

It is interesting to note that we do not get stronger inter- 
polation theorems for prerequisite-free normal default the- 
ories. [Imielinski, 1987| provided a modular translation of 



normal default theories with no prerequisites into circum- 
scription, but Theorem 3.8 does not lead to better results. 



In particular, the counter example that we presented after 
that theorem can be massaged to apply here too. 

Theorem 4.5 (Interpolation Between Default Extensions) 

Let (VFi, Di), (W2, -D2) be default theories such that 
L{cons{D2)) n L{pre{Di) U just{Di) U Wi) = 0. Let 
tp be a formula such that ip G C{W2 U 02). If there is an 
extension E of {Wi U W2 , Di U D2) in which (p holds, then 
there is a formula ^ G £(Vl^iUDi)n£(H^2UD2)> anexten- 
sion El of{Wi,Di) such that Cn{Ei)nC{W2U D2) = 7, 
and an extension E2 of {W2 U {7}, D2) such that E2 \^ >p. 

Proof Let D[ C Di be the set of generating defaults 
of E that belong to Di. Notice that these defaults are 
grounded in Wi because there is no information that may 
have come from applying the rest of the generating defaults 
in E (we required that cons{D2) H {pre{Di) lJjust{Di) U 
W) = 0). Let El be the extension of {Wi,Di) defined 
using the generating defaults in D[. 

Let 7 G C{Wi U Di) n C{W2 U D2) be the conjunction 
of the sentences in that language that follow from Ei. Let 
D2 ^ D2 be the set of generating defaults of E that belong 
to D2- Notice that these defaults are grounded in W2 U 7 
because there is no information that D[ may contribute that 
is not already in 7 (we required that cons{D2)n{pre{Di)U 
just{Di) UW) = 0). Let E2 be the extension of {W2 U 
7, 1)2} defined with the generating defaults in 

Now, El U E2 = E, and 7 is the set of sentences that fol- 
low from El in C{Ei) n £(£'2 U ip). -E2_N V because 
of Craig's interpolation theorem (Theorem 2.1 ) for prepo- 
sitional logic: EiL) E2 H iy3 implies that Ei E2 =>■ (fi, 
and Craig's interpolation theorem guarantees the existence 
of 7' G C{Ei) n /:{E2 U (p) such that Ei |= 7' and 
y \= E2 ip- Thus, 7' G 7 and 7 ^ i?2 => <y5. This 
implies 7 U £^2 H V which implies that E2 ^ ip- ■ 

It is interesting to notice that the reverse direction of this 
theorem does not hold. For example, if we have two ex- 
tensions El , E2 as in the theorem statement, it is possible 
that El uses a default with justification f3, but W2 \= -^(3- 
Strengthening the condition of the theorem, i.e., demanding 
ihatL{W2Llcons{D2))riL{pre{Di)Ujust{Di)UWi) = 
0, is not sufficient either For example, if Di includes two 



defaults di 



r, and d2 



^, Wi 



1), D2 includes 



no defaults and W2 = {a} then there is no extension of 
{Wi \JW2,Di[J D2) that implies p, for ip = {c}. 

Further strengthening the conditions of the theorem gives 
the following: 



Theorem 4.6 (Reverse Direction of Theorem 4.5) 

Let {Wi, Di) , {W2, D2) be default theories such that 



L{W2 U cons{D2)) n L{Di U Wi) = 0. Let tp be a 
formula such that (p G C(W2 U 02). There is an extension 
E of (Wi U W2, Di U D2) in which ip holds only if there is 
a formula 7 G C{Wi U Di) D C(W2 U D2), an extension 
El of {Wi,Di) such that Cn{Ei) n C{W2 U D2) = 7, 
and an extension E2 of {W2 U {7}, D2) such that E2 ^ >p. 

Proof Let Ei , E2 be as in the statement of the theo- 
rem. Let TTi,7T2 be the sets of defaults applied in Ei,E2, 
respectively. Let E = Cn{Ei U E2), and let vr = vri U tt2- 
We show that E is an extension of {Wi U W2, Di U D2) 
such that E \^ (p as needed. 

First, E D Wi U W2 by E's definition. For every d = 

"'^^7d ''^" ^ "-"^ "fd ^^^'^ because they hold in one of 
El, E2 (d ^ TT — TTi (J TT2)- Assumc that (3i € E for some 
i < n. Then, i?i U i?2 h implying that Ei\= E2 ^ 
-^(3i (we treat Ei , E2 here as finite sets of formulae because 
they are in prepositional logic). 

If d G TTi, then clearly -^Pi G C{Wi U Di). Ei U \= 
-^E2- Using Craig's interpolation theorem we get that 
7 from the theorem's statement satisfies {7} U {f3i} \= 
^E2- Consequently, i?2 H 7 However, E2 — 

Cn{cons{-K2) U W2 U {7}), and L{W2 U cons{D2)) n 
L{Wi U Di) = 0. This means that L(cons(7r2) U W2) n 
L(7 A Pi) — 0, implying that 7 |= contradicting 

i El. 

If d G TTs, then G C{W2 U D2). Since Ei ^ E2 ^ 
-^f3i, we get from Craig's interpolation theorem that 7 |= 
E2 -1/3;. However, 7 G £^2 by the definition of E2- 
Thus, E2 \= -^(3, contradicting the fact that d is a default 
applied in E2. 

In conclusion, ^ E. Thus, all the defaults in tt are 
applied in E. It is also simple to see that no other default is 
applied in E. 

If there is a default d = G Di that should apply 

in E but is not in tt, then its preconditions and justifications 
hold in E. However, this means that a follows from Ei U 
E2, and E2 = C*n(cons(7r2) U W2 U {7}). Similar to the 
argument above we get that Ei |= a. Similarly, we get that 
if f3i ^ E then Ei ^ implying that d should have 
applied in Ei, contradicting the fact that Ei is an extension 
of{WuDi). 

If there is a default d = G D2 that should apply 

in E but is not in tt, then its preconditions and justifications 
hold in E. A similar argument to the one above shows that 
it should have applied in E2 too, contradicting the fact that 
E2 is an extension. 

Minimality of E follows from that of Ei,E2- Thus, E is 
an extension of {Wi U W2,Di U D2) as needed. ■ 



Corollary 4.7 (Interpolation for Brave DL) Let 

lyVi, Di) ^ iyV2, D2) be default theories such that 
L{cons{D2)) n L{pre{Di) U just{Di) U Wi) = 0. 
Let if be a formula such that ip G C{W2 U 02). 
If Wi U W2 \^'diuD2 'fi' t^^^^ there is a formula, 
7 e C{Wi U Di) n C{W2 U D2), such that Wi Y^^,^ 7 
and W2 U {7} h-J,^ ^. 



Corollary |4.7| does not hold for the cautious case (where 
we look at all the extensions and choose ip and 7 satisfied 
by all of them): Let Wi ^ W2 ^ 0, = , ^} and 
D2 = ^7^}- There are two extensions, in both of 
which c is proved, but Wi Y^Di 1 only for 7 = TRU E. 

Better interpolation theorems may hold (e.g., theorems 
that do not depend on cons{D2), pre{Di), etc., and pro- 
vide 7 e C{{Wi,Di)) n C{{W2,D2))), if we consider 
the entailment between two default theories {{Wi, Di) |~ 
(W2, 02))- These are outside the scope of this paper. 



Finally, Corollary 4.7 and Theorem 4.5 are similar to 
the splitting theorem of [Turner, 1996], which is provided 
for default theories with W = % (there is a modular 
translation that converts every default theory to one with 
W — 0). We briefly review this result. A splitting set 
for a set of defaults D is a subset A of L{D) such that 
pre{D),just{D),cons{D) C C{A) U C{L{D) \ A) and 
-id € D {cons{d) i C{L{D) \ A) ^ L{d) C A). 
Let B = L{D) \ A. The base of D relative to A is 
hA{D) = {d G -D I L{d) C A). For a set of sentences 
X CC[A),WQ define 



h({ai}i<^nC{B)):{hi}i<^nC(B) 



lsLiJ^rh^eD\bA{D), 

\fi < m{-^h i Cn'^iX)) 



Theorem 4.8 ([I\irner, 1996]) Let Abe a splitting set for 



a default theory D over C{U). A set E of formulae is a 
consistent extension of D iff E — Cn^'^^(X U Y), for 
some consistent extension X ofba{D) over C{A) and Y a 
consistent extension ofeA{D, X) over C{L{D) \ A). 

Roughly speaking, this theorem finds an extension X of the 
base (bA{D)) and converts D \ bA{D) using this X into 
a theory eAiD,X). Then, an extension Y for eA{D,X) 
completes the extension for D if X UY is consistent. In 
contrast, our theorem does not change D \ &^(_D), but it 
is somewhat weaker, in that it only provides a necessary 
condition for D [^^ (f. (however, notice that this weaker 
form is typical for interpolation theorems). 



5 Logic Programs 

In this section we provide interpolation theorems for logic 
programs with the stable models semantics. We use the fact 
the logic programs are a special case of default logic, and 
the results are straightforward. 



An 

gram 



extended 



disjunctive 



logic 



pro- 



[3elfond and Lifschitz, 1988, 



elfond and Lifschitz, 199C, 3elfond and Lifschitz, 1991 



F'rzymusinski, 1991] is a set of rules. Each rule, r, is 



written as an expression of the form 

Li\...\Li ^ Ai, An, notBi, ...,notB.,n 

where Li, Li, Ai, An, Bi, Bm are literals, that is, 
atomic formulae or their (classic) negations, Li, ...,Li are 
the head literals, head{r), Ai, An are the positive sub- 
goals, pos{r), and Bi, ...,Bm are the negated subgoals, 
neg{r). 

A program P is positive if none of its rules includes negated 
subgoals. A set of literals, X, is closed under a positive 
program, P, if, for every rule r E P such that pos{r) C X, 
head{r) n X ^ 0. A set of literals is logically closed if 
it consistent or contains all literals. An answer set for a 
positive program, P is a minimal set of Uterals that is both 
closed under P and logically closed. 

For an arbitrary logic program, P, and a set of literals, X, 
we say that X is an answer set for a program P if X is an 
answer set for P^ , where P^ is defined to include a rule 

r' iff neg{r') = and there is r e P such that head{r') = 
head(r), pos{r') — pos{r), and neg{r) fl X = 0. 

Logic programs with answer-set semantics were shown 
equivalent to default logic in several ways. For normal rules 
(rules of the form A <— Bi, B^, not Ci, not Cn, 
where A,Bi, ...,B„i,Ci, ...,Cn are atoms (i.e., 
no disjunction or classic negation is allowed)), 
[Gelfond and Lifschitz, 1991 1 translated every normal 

not Ci, not Cn, 



rule of the form A 
into a default 



Pi 



Pi A ... A Bn 



, B„ 



Under this mapping, the stable models of a logic program 
coincide with the extensions of the corresponding default 
theory (Facts in the logic program are translated to facts in 
the default theory, while rules are translated to defaults). 



[ Sakama and Inoue, 1993 1 showed that disjunctive logic 
programs (no classic negation) with the stable model se- 
mantics can be translated to prerequisite-free default theo- 
ries as follows; 



1. For a rule 

Bi,...,B,n, not Ci,. 



Ai\...\Ai 
not Cn in P, we get 



the default 



6 Summary 



Bi A... AB,„ ^ AiV ...V Ai 



2. For each atom A appearing in P, we get the default 



Each stable model of P is the set of atoms in some ex- 
tension of Dp, and the set of atoms in an extension 
of _Dp is a stable model of P (notice that, in general, 
an extension of Dp can include sentences that are not 
atoms and are not subsumed by atoms in that extension). 



[Sakama and Inoue, 1993 1 provide a similar translation to 



extended disjunctive logic programs by first translating 
those into disjunctive logic programs (a literal -^A is trans- 
lated to a new symbol. A'), showing that a similar property 
holds for this class of programs. 

We define P ip as cautious entailment sanctioned from 
the logic program P, i.e., ip follows from stable model of 
P. We define P j'^'' (p as brave entailment sanctioned from 
the logic program P, i.e., (p follows from at least one stable 
model of P. 

From the last translation above we get the following inter- 
polation theorems. 

Theorem 5.1 (Interpolation for Stable Models (Cautious)) 

Let P be a logic program and let ip be a formula such that 
P \^ ip. Then, there is a formula 7 G C{P) H C{(p) such 
that P |~ 7 and 7 



Proof Follows immediately from Theorem^^ with 72 
over there corresponding to our needed 7. ■ 

Theorem 5.2 (Interpolation for Stable Models (Brave)) 

Let Pi,P2 be logic programs such that head{P2) H 
body (Pi) — 0. Let ip e -^(^2) be a formula such that 
Pi UP2 ^- Then, there is a formula 7 G C{Pi)r\C{P2) 
such that Pi 7 and 7 U P2 Y^^ f- 

Proof Follows directly from the reduction into default 
logic and Corollary 4.7. ■ 



The last theorem is simila r to the splitting theorem of 
[ Lifschitz and Turner, 1994 1 . This theorem finds an answer 
set X of the bottom (Pi) and converts P2 using this X into 
a program Pj'. Then, an answer set Y for Pj completes 
the answer set for Pi U P2 if X U F is consistent. In con- 
trast, our theorem does not change P2, but it is somewhat 
weaker, in that it does only provides a necessary condition 
for Pi U P2 [^^ p (this is the typical form of an interpola- 
tion theorem). 



We presented interpolation theorems that are applicable to 
the nonmonotonic systems of circumscription, default logic 
and Answer Set Programming (a.k.a. Stable Models Se- 
mantics). These results are somewhat surprising and re- 
vealing in that they show particular structure for the non- 
monotonic entailments associated with the different sys- 
tems. They promise to help in reasoning with larger sys- 
tems that are based on these nonmonotonic systems. 

Several questions remain open. First, 7 promised by our 
theorems is not always finite (in the FOL case). This is in 
contrast to classical FOL, where the interpolant is always 
of finite length. What conditions guarantee that it is finite in 
our setup? We conjecture that this will require the partial 
order involved in the circumscription to be smooth. Sec- 
ond, are there better interpolation theorems for the priori- 
tized case of those systems? Also, what is the shape of the 
interpolation theorems specific for prerequisite-free semi- 
normal defaults? Further, our results for default logic and 
logic programs are propositional. How do they extend to 
the FOL case? 

Finally, the theorems for default logic and Logic Program- 
ming promise that a \--^d P implies the existence of 7 such 
that a 7 and 7 (3. However, we do not know that 
the other direction holds, i.e., that the existence of 7 such 
that a 7 and 7 (3 implies that a P- Can we 
do better than Theorem |4.6| for different cases? 
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